Mini/Micro-Grid Adaptive Voltage and Frequency Stability Enhancement Using Q-learning Mechanism

This paper develops an adaptive control method for controlling frequency and voltage of an islanded mini/micro grid (M/µG) using reinforcement learning method. Reinforcement learning (RL) is one of the branches of the machine learning, which is the main solution method of Markov decision process (MDPs). Among the several solution methods of RL, the Q-learning method is used for solving RL in this paper because it is a model-free strategy and has a simple structure. The proposed control mechanism is consisting of two main parts. The first part is a classical PID controller which is fixed tuned using Salp swarm algorithm (SSA). The second part is a Q-learning based control strategy which is consistent and updates it's characteristics according to the changes in the system continuously. Eventually, the dynamic performance of the proposed control method is evaluated in a real M/µG compared to fuzzy PID and classical PID controllers. The considered M/µG is a part of Denmark distribution system which is consist of three combined heat and power (CHP) and three WTGs. Simulation results indicate that the proposed control strategy has an excellent dynamic response compared to both intelligent and traditional controllers for damping the voltage and frequency oscillations.